©2014  Carnegie  Mellon  University 


Software  Engineering  Institute 
Carnegie  Mellon  University 
Pittsburgh,  PA  15213 


Brownsword,  Place,  Albert,  Carney 

October  2014 


r  Software  Engineering  Institute  Carnegie  Mellon  University 


Fall  2014 


SEI  Research  Review 


ning  Acquisition  Strategy 
and  Software  Architecture 


Report  Documentation  Page 

Form  Approved 

0MB  No.  0704-0188 

Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 

VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  0MB  control  number. 

1 .  REPORT  DATE  2.  REPORT  TYPE 

01  OCT  2014  N/A 

3.  DATES  COVERED 

4.  TITLE  AND  SUBTITLE 

Fall  2014  SEI  Research  Review:  Aligining  Acquisition  Strategy  and 
Software  Architecture 

5a.  CONTRACT  NUMBER 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

6.  AUTHOR(S) 

Place  /Lisa  Brownsword  Cecilia  Albert  David  Carney  Patrick 

5d.  PROJECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

Software  Engineering  Institute  Carnegie  Mellon  University  Pittsburgh, 

PA  15213 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

10.  SPONSOR/MONITOR’S  ACRONYM(S) 

11.  SPONSOR/MONITOR’S  REPORT 
NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release,  distribution  unlimited. 

13.  SUPPLEMENTARY  NOTES 

The  original  document  contains  color  images. 

14.  ABSTRACT 

15.  SUBJECT  TERMS 

16.  SECURITY  CLASSIFICATION  OF:  17.  LIMITATION  OF 

18.  NUMBER  19a.  NAME  OF 

a.  REPORT  b.  ABSTRACT  c.  THIS  PAGE  SAR 

unclassified  unclassified  unclassified 

12 

standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


Copyright  2014  Carnegie  Mellon  University 


This  material  is  based  upon  work  funded  and  supported  by  the  Department  of  Defense  under 
Contract  No.  FA8721-05-C-0003  with  Carnegie  Mellon  University  for  the  operation  of  the 
Software  Engineering  Institute,  a  federally  funded  research  and  development  center. 

NO  WARRANTY.  THIS  CARNEGIE  MELLON  UNIVERSITY  AND  SOFTWARE 
ENGINEERING  INSTITUTE  MATERIAL  IS  FURNISHED  ON  AN  “AS-IS”  BASIS.  CARNEGIE 
MELLON  UNIVERSITY  MAKES  NO  WARRANTIES  OF  ANY  KIND,  EITHER  EXPRESSED 
OR  IMPLIED,  AS  TO  ANY  MATTER  INCLUDING,  BUT  NOT  LIMITED  TO,  WARRANTY  OF 
FITNESS  FOR  PURPOSE  OR  MERCHANTABILITY,  EXCLUSIVITY,  OR  RESULTS 
OBTAINED  FROM  USE  OF  THE  MATERIAL.  CARNEGIE  MELLON  UNIVERSITY  DOES 
NOT  MAKE  ANY  WARRANTY  OF  ANY  KIND  WITH  RESPECT  TO  FREEDOM  FROM 
PATENT,  TRADEMARK,  OR  COPYRIGHT  INFRINGEMENT. 


This  material  has  been  approved  for  public  release  and  unlimited  distribution  except  as 
restricted  below. 


This  material  may  be  reproduced  in  its  entirety,  without  modification,  and  freely  distributed  in 
written  or  electronic  form  without  requesting  formal  permission.  Permission  is  required  for  any 
other  use.  Requests  for  permission  should  be  directed  to  the  Software  Engineering  Institute  at 
permission@sei.cmu.edu. 

DM-0001750 


_  _  Fall  2014  SEI  Research  Review 

Software  Engineering  Institute  Carnegie  Mellon  University  Brownsword,  28-30  October  2014  2 

©2014  Carnegie  Mellon  University 


Interplay  of  Acquisition  and  Architecture 


monolithic  legacy 
architecture 


new  modular  architecture  with 
new  and  legacy  capabilities 


Should  I  have  1  contractor,  or  2  or  3  or  6? 

If  1  contractor,  how  do  I  enforce  a  modular  architecture? 

If  multiple  contractors,  how  do  I  ensure  the  parts  fit  together? 
Can  I  migrate  legacy  to  give  me  a  quick  delivery? 
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Purpose  of  Our  Research 


Can  we  improve  the  probability  of  a  program’s  success  through  a 
method,  to  be  used  by  PMOs,  that  produces  mutually  constrained  and 
aligned  program  acquisition  strategy  and  software  architecture? 

Why  this  is  important 

•  Software  is  increasingly  important  to  the  success  of  government  programs. 

•  There  continues  to  be  little  consideration  of  the  software  architecture  in  the 
development  of  either  the  system  architecture  or  the  program’s  acquisition 
strategy. 

•  Software  architecture  is  often  over  constrained  by  decisions  made  early  in  the 
acquisition  lifecycle  when  key  program  choices  are  being  made — negatively 
affecting  program  success. 
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♦>  ♦> 


Our  Early  Research 


Discovered  reoccurring  patterns  of  failure 

Identified  key  entities  and  relationships  involved  in  those  failures 


Entity 


4  » 

relationship 


System  and 

System  and 

Quality  Attributes 

drive 

Architecture 

Alignment  of  acquisition  strategy  and  software  and  system 
architectures  does  not  occur  naturally 
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Research  Opportunities 


#1 :  Define  a  systematic  way  to  get 
from  goals  to  an  acquisition  strategy 
(FY14) 


Acquisition 
Quality  Attributes 


Acquisition 

Strategy 


t  t 

#2:  Introduce  “touch  points” 
between  acquisition  strategy 
and  architecture  (Future) 

System  and  System  and 

Software  <  »  Software 

Quality  Attributes  Architecture 


Nearly  20  years  of  experience  reflecting  goals, 
through  quality  attributes,  to  system  and 
software  architectures  (Completed  -  SEI 
architecture  research) 
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Goal  Determination 


Acquisition 

Strategy 


System  and 
Software 
Architecture 


Entity 


relationship 


Focus  on  capturing  business  and 
mission  goals 

>  Identify  stakeholders 

>  Elicit  business  goals 

>  Represent  goals  in  standard 
form* 

Analyze  goal  subjects  and 
objects  to  identify  additional 
stakeholders 


Note:  applies  for  elicitation  of 
mission  goals 

*Business  goal  scenarios  found  in  SEI  TN  CMU/SEI-2010-TN-018: 

“Relating  Business  Goals  to  Architecturally  Significant 
Requirements  for  Software  Systems" 
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Acquisition  Quaiity  Attribute  (AQA)  Consistency 


Example  AQAs 

Flexibility 

Executability 

Performability 

Responsiveness 

Realism 

Programmatic 

Transparency 

Affordability 

Innovativeness 

Survivability 

Schedulability 

Characterize  relationship  between 
AQA  scenarios  and  acquisition 
strategy 

>  Based  on  research  that  captured 
75  scenarios  across  23  programs* 

>  Defined  types  of  scenarios  that 
might  occur  for  a  given  AQA 

>  Created  acquisition  strategy 
tactics  associated  with  AQAs 


Entity 


relationship 


*Results  published  in  SEI  TN  CMU/SEI-2013-TN-026: 

“Results  in  Relating  Quality  Attributes  to  Acquisition  Strategies" 
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Value  of  AQA  scenarios^ 

AQA  scenarios  can  be  used  to 

•  Express  effects  of  business  and  mission  goals 

•  Inform  the  development  of  the  acquisition  strategy 

•  Determine  appropriateness  of  acquisition  strategy  with  respect  to  any  given 
scenario 


Acquisition 

Quality 

Attribute 

Scenario 

Potential 

Acquisition  Tactic 

Flexibility 

The  user’s  system  requirements  change  radically  30 
days  before  the  RFP  is  released  and  the  “go  live”  date 
is  fixed;  the  RFP  is  released  regardless. 

Establish  fallback 
strategies  that  protect  the 
“go  live”  date. 

Affordability 

The  program  discovers  that  the  cost  of  operating  the 
system  will  be  higher  than  the  ceiling  mandates  during 
development  but  before  initial  fielding;  the  system 
(including  its  architecture)  is  shifted  to  a  less  costly 
alternative. 

Emphasize  the  need  for 
architecture  adaptability. 
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Value  of  AQA  scenarios2 

>  Scenarios  can  help  identify  possible  incompatibilities 


Stakeholder  A:  advocates  use  of  open  Stakeholder  B:  is  responsible  for 
source  software  as  a  means  of  ensuring  that  the  deliverables  meet 

increasing  responsiveness  to  users  rigorous  safety  standards 


Stimulus 

Users  request  significant  new 
functionality  to  be  delivered 
rapidly 

Stimulus 

A  new  requirement  to  adhere 
to  a  rigorous  safety  standard 
is  applied  to  the  system 

Environment  during  the  program's 
development  phase 

Environment 

during  the  program's 
development  phase 

Response 

create  the  functionality  rapidly  . 
by  reusing  open  source  and 
software  from  other  projects  to^ 
provide  much  of  the  capability. 

.Response 

The  developers  remove  all 
unreachable  code  to  insure 
that  the  system  will  pass 
stringent  new  certification 
standards. 
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Wrap  Up 


#1 :  Define  a  systematic  way  to  get 
from  goals  to  an  acquisition  strategy 
(FY14) 


Acauisition 

Acquisition 

Quality  Attributes 

Strategy 

t 

t 

#2:  Introduce  “touch  points” 
between  acquisition  strategy 

and  architecture  (Future) 


System  and 

System  and 

Quality  Attributes 

Architecture 

Nearly  20  years  of  experience  reflecting  goals, 
through  quality  attributes,  to  system  and 
software  architectures  (Completed  -  SEI 
architecture  research) 


Our  research  has  defined  an  initial 
alignment  method* 

>  Fosters  explicit,  program-specific, 
discussion  of  the  goals  that  are 
driving  the  program 

>  Allows  for  more  reasoned  analysis 
and  tradeoffs  among  the  goals 
through  the  use  of  scenarios; 
making  conflicts  more  visible 

>  Assists  in  ensuring  that  the  goals 
are  supported  in  the  acquisition 
strategy 

More  research  is  needed  that 
focuses  on  research  opportunity  #2 


*lnitial  alignment  method  to  be  published  in  SEI  TN  CMU/SEI-2014-TN-019: 
“A  Method  for  Aligning  Acquisition  Strategies  and  Software  Architectures" 
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